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(57) Abstract 

Systems and methods for selecting and inserting advertise- 
ments in an information document displayed to a user, wherein 
the selection is based at least in part on television programming 
viewed by die user. The systems and methods may be imple- 
mented using the Internet or another information retrieval system 
that includes a client system (10) and a remote server (16). The 
client system (10) monitors television programming (52) viewed 
by the user and compiles a user profile (54) characterizing the tele- 
vision programming. When die user requests an Internet resource 
using the client system (10). the television programming informa- 
tion in the user profile (54) is utilized (64) to select an appropriate 
advertisement (78). The advertisement (78) is then inserted (76) 
in the information document (22) and displayed (20) to the user. 
Such selection of advertisement increases the efficiency by which 
Internet advertisements are tailored to individuals. Instead of ad- 
vertisements, information relating to the television programming 
may be retrieved over the Internet and displayed widiout direct 
user assistance. 
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SYSTEM AND METHOD OF INSERTING ADVERTISEMENTS INTO AN 
INFORMATION RETRIEVAL SYSTEM DISPLAY 
BACKGROUND OF THE INVENTTON 
1- The Fidd of the Invention 

The present invention relates to advertising on an infonnation retrieval system. 
In particular, the present invention relates to systems and methods of selecting 
advertisements and displaying the selected advertisements on an infonnation retrieval 
system based at least in part on the television viewing habits of the recipient of the 
advertisements. 

2. The Prior State of the Art 

The Internet, and particulariy the Worid Wide Web ("Web"), has experienced 
tremendous growth during recent years. The Web allows users to retrieve and access 
text, graphics, audio, video, and other information from remote servers. The WA has 
become a valuable source of news, educational resources, commercial information, 
emertainment, and the like. Many, if not most, Web sites are accessible by users free 
of diarge. Other sites are made available to users for a small fee. Many Web sites 
subsidize part or all of the cost of maintaining a server, posting information in Web 
pages, etc. by selling and distributing advertisements embedded in Web pages. 

As in other advertiang applications, it has been found that advertisements in 
Web pages are most effective if they can be tailored and directed to segments of the 
population that are likely to be interested in the advertised goods and services. 
Because of the interactive nature of the Internet and the ability to easily insert 
graphical images in Web pages, there have been developed several methods of 
targeting Internet advertisements to specific users or specific groups of users. 

One of the simplest methods of tailoring Internet advertisements to recipients 
is similar to techniques used in television, radio and other media! In particular, 
advertisements are selected to correspond to the subject matter of the Web page or 
other Internet resource. It is assumed that users who actively retrieve Imemet 
resources dealing with a certain topic are more likely than the population at large to 
be receptive to advertisements directed to the topic. For example, if a Web site relates 
to travel information, advertisers and Web site providers can generally assume that 
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users accessing the Web site vdll have a heightened interest in travel-related 
advertisements. 

Advertisements are particularly attractive in the Internet enviromnent for 
several additional reasons. First. Internet users are typicaUy actively and attentively 
takmg in infonnation when they access Internet resources. Such users may be more 
receptive to messages deUvered by advertisers than persons engaged m other 
activities. Second, because of the interactive nature of the Internet, recipients of 
advertising may choose to receive a smaU amount or a relatively large amoum of 
infonnation on the advertised goods or services. For example, a typical Internet 
advertisement may consist of a bamier box or another graphical image identifying the 
goods or services or presenting a concise advertising message. Moreover, the 
graphical image is frequently an active link that may be selected by the user in order 
to access a Web site specifically dedicated to the advertised goods or services 
Accordingly, imerested recipients may easily retrieve additional infonnation relating 
to advertiser's message, while disinterested recipients are not inconvenienced by too 
much unwanted infonnation. The multimedia aspect of the Internet also allows 
advertisers to present their messages in new and interesting ways. 

In addition to basing advertisement selection on the subject matter of Web 
sites, advertisers have also been able to leam of some preferences and habits of 
recipients in order to more effectively tailor advertisements. Many Web sites 
download "cookies" to users' computers when users access the Web sites. Cookies 
are files installed and stored on the hard disk of cUent computers and are used to 
report infonnation relating to the cliem computer to Web site content providers. In 
one example, a cookie may merely be an identifier that transmits a user password or 
other identifying infonnation each time the user retums to the Web site tiiereby 
ehminating the need for the user to remember and enter the password. In another 
example, however, cookies can be used to track and report the user's Internet habits 
givmg content providers and advertisers insight into the possible interests of the user, 
and allowing advertisements to be taUored accordingly. 

Services that automatically provide news and other infonnation to recipients 
over ti.e Internet have also become common. For example, there are many e-mail 
services and other Internet-based systems that periodically send messages or other 
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informtion documents relatmg to spedfic topics to interested pers^ GeneraUy. 
such services provide information to recipients who have placed their names in a 
subscriber list. There is typically no attempt to individually taUor the information sent 
to the subscribers based on the subscribers' particular preferences other than perhaps 
an interest survey submitted by the subscribers. 

In view of the foregoing, advertising techniques adapted from other media 
have been widely used to tailor advertisements to broad segments of the Internet- 
using population. Furtiiermore, interactive techniques, such as those involving 
"cookies", allow advertisers to leam of some of the recipient's habits as tiiey relate to 
browsing Internet and otherwise using the recipient's computer. While such 
information increases ihc efficiency by which advertisers may target specific 
recipients, any further source of information relating to individual habits and 
preferences would be a valuable improvement in the Internet advertising industry. 

From tiie standpoint of tiie advertiser, any increase in tiie ability to narrowly 
target recipients would make advertising on tiie Internet more attractive. Internet 
content providers would also favor advancements in advertising eflfectiveness. since 
tiiey would then collect more advertising fees from advertisers. FinaUy. tiie Internet- 
using public benefits from being more effectively targeted in at least two ways. First, 
advertising recipients would be more likely to receive advertising information tiiat is 
of interest and value. Second, a greater number and variety of Internet sites are likely 
to be profitable usmg improved advertising techniques, tiiereby making more no-cost 
and low-cost Internet sites available to the public. 

SUMMARY O F THE INVICNTIQN 
The present invention relates to selecting advertisements and displaying the 
selected advertisements on a display screen of an information retrieval system based 
at least in part on tiie television viewing habits of the recipient of the advertisements. 
For example, tiie information retrieval system may be tiie Internet, with the 
advertisements being embedded and displayed in a Web page or another Internet 
resource. Monitoring tiie television viewing habits of the recipient allows the 
advertisements to be more effectively taUored to tiie specific habits and preferences of 
the recipient. 
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The invention may be implemented in an infonnation retrieval system 
including a client terminal and a remote seiver configured to communicate one Avith 
another. In Internet implementations, an Internet service provider ("ISP") may also 
be present in order to feciUtate and route information transmission over the system. 
Moreover, the client tenninal is comiected to. associated with, or otherwise has access 
to a television set or a television programming feed. According to the invention, the 
client tenninal monitors television programming viewed by the user, and includes the 
television viewing habits in a user profile. 

When the user requests an information document, such as a Web page, from a 
remote server, the user profile is used in conjunction with selection criteria to select 
an advertisement appropriate for the user. Data representing the selected 
advertisement is inserted into the information document, and when the infonnation 
document is displayed to the user, the selected advertisement is also displayed. The 
process of selecting and inserting the advertisement may be conducted according to 
any of at least three methods. In particular, the advertisement selection and insertion 
may be conducted at the client computer, at the server computer, and in Internet 
unplementations, at the ISP. Moreover, selection and insertion may be conducted at 
any combination of the foregoing sites. 

The foregoing methods of advertisement selection and insertion more 
generally extend to selection and display of any type of infonnation to a recipient 
based at least in part on television viewing habits. As described herein, the client 
tenninal monitors television programming viewed by the user and compUes a user 
profile. The user profile is compared against a list of infonnation categories, which 
may be standard or user^efined. One or more of the infonnation categories that 
correspond to the user profile are then used to request infonnation documents from 
the server computer. For example, the invention may be implemented in an Internet 
news delivery service wherein the infonnation categories conespond to particular 
categories of news stories. Accordingly, infonnation such as news, entertainment, 
educational resources, and the Uke, may be selected based at least in part on the 
television viewing habits of the recipient, automatically retrieved, and made available 
to the recipient. 
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In view of the foregoing, the invention disclosed herein provides methods and 
systems for tailoring advertisements and other infomation to specific recipients in 
ways that have not previously been possible. Monitoring the television viewing 
habits of recipients aUows advertisers and content providers to gain valuable insight to 
the preferences of the users. Accordingly, the advertisements or other selected 
information is more likely to be relevant and of interest to the recipient using the 
invention than using conventional methods. 

Additional advantages of the invention wiU be set forth in the description 
which foUows, and in part wiU be obvious fi-om the description, or may be learned by 
the practice of the invention. The advantages of the invention may be realized and 
obtained by means of the instmments and combinations particulariy pointed out in the 
appended chiims. These and other features of the present invention wiU become more 
folly apparent fi-om the foUowing description and appended claims, or may be learned 
by the practice of the invention as set forth herdnafter. 

BRIEF DEsrRiPTfnisf OF thtc nw awings 
In order that the manner in which the above-recited and other advantages of 
the invention are obtained, a more particular description of the invention briefly 
described above will be rendered by reference to specific embodiments thereof which 
are illustrated in the appended drawings. Understanding that these drawings depict 
only typical embodiments of the invention and are not therefore to be considered 
limiting of its scope, the invention will be described and explained with additional 
specificity and detail through the use of the accompanying drawings in which: 

Figure 1 is a schematic diagram illustrating a networic system in which the 
invention may be implemented, wherein the networic system includes client terminals, 
servers, and a television programming source. 

Figure 2 is a schematic diagram of one embodiment of a client system for use 
with the invention. 

Figure 3 A is a schematic diagram depicting a first embodiment of the systems 
and methods of the invention, wherein an advertisement is selected and inserted into 
an information document at the server computer. 
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Figure 3B is schematic diagram showing a second embodiment of the systems 
and methods of the invention, Avherein an advertisement is selected and inserted into 
an information document at the level of the Internet service provider. 

Figure 3C is a schematic diagram iUustrating a third embodiment of the 
systems and methods of the invention, wherein an advertisement is selected and 
inserted into an information document at the client system. 

Figure 4 is a flow diagram depicting selected steps of the methods associated 
with Figures 3 A-3C. 

Figure 5 is a schematic diagram showing a further embodiment of the systems 
and methods of the invention, wherein information classified under specified 
categories is selected, retrieved, and displayed based at least in part on the television 
viewing habits of the recipient. 

Figure 6 is a schematic diagram further illustrating a television monitoring 
module and assodated elements of the systems of the invention. 

DETAILED DESrWTP TION OF THE PREFERWFD EMBODIMENT 

The present invention relates to selecting and displaying advertisements or 
other information on a display device of an information retrieval system based at least 
in part on the television viewing habits of the recipient. A cUent terminal or the like 
monitors the television viewing habits of the recipiem, which are included in a user 
profile. The user profile, in combination with selection criteria, may be used to select 
advertisements for display to the recipient. When the recipient requests an 
information document using the information retrieval system or when an information 
document is otherwise delivered to the cUent terminal, the selected advertisemem is 
inserted into the information document and is displayed to the recipient. 

The invention is described below by using diagrams to illustrate either the 
structure or processing of embodiments used to implement the system and method of 
the present invention. Using the diagrams in this manner to presem the invention 
should not be construed as limiting of its scope. The embodiments of the present 
invention may comprise a special purpose or general purpose computer mcluding 
various computer hardware, as discussed in greater detail below. The embodiments 
may fiirther comprise multiple computers Unked in a networic environment. 
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Embodiments within the scope of the present invemion include computer 
readable media having computer-execuUble instructions or data fields stored thereon. 
Such computer readable media can be any avaUable media which can be accessed by 
a general purpose or special purpose computer. By way of example, and not 
limitation, such computer readable media can comprise RAM, ROM, EEPROM, CD- 
ROM or other optical disk storage, magnetic disk storage or other magnetic storage 
devices, or any other medium which can be used to store the desired computer- 
executable instructions or data fields and which can accessed by a general purpose or 
special purpose computer. Combinations of the above should also be included within 
the scope of computer readable media. Computer-executable instructions comprise, 
for example, instructions and data which cause a general purpose computer, special 
purpose computer, or special purpose processing device to perform a certain fiinction 
or group of fiinctions. The computer-executable instructions and associated data 
fields represent an example of program code means for executing the steps of the 
invention disclosed herein. 

Figures 1 and 2 and the foUowing discussion are intended to provide a brief, 
general description of a suitable network and computing environment in which the 
invention may be implemented. Although not required, the invention wUI be 
described in the general context of computer-executable instructions, such as program 
modules, being executed by a personal computer. Generally, program modules 
include routines, programs, objects, components, data struaures, etc. that perform 
particular tasks or implement particular abstract data types. The invention will also be 
described by making reference to information documents, which generally include or 
are defined by encoded data structures stored in a computer-readable medium or a 
computer memory device. The encoded data structures of documents typically 
represent text, graphical images, audio, or other information that may be 
communicated to a user, and generally may be generated, edited, displayed and/or 
stored using a computer. The information documents may be Web pages or other 
Internet resources. 

For iUustration purposes, the invention is described herein in reference to the 
Internet, which represents one example of information retrieval systems that are 
compatible with the invention. However, the principles disclosed herein are also 
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appUcable to other irfonnation retrieval systems. Accordingly, it is to be understood 
that the invention is not to be Umited to the Memet. Those skilled in the art wUl 
understand how to implement the invention in other information retrieval systems 
upon learning of the information disclosed herein. 

Figure 1 iUustrates one embodiment of the architecture of an information 
letrieval system in which the invention may be implemented. In this embodiment, 
multiple clients systems 10 communicate with a modem pool 12 by means of direct- 
dial, bi-directional data comiections 14. which may be conventional telephone lines. 
ISDN connections, connections supported by cable television providers, or any other 
suitable communications chamiel. Modem pool 12 may be any conventional modem 
pool, such as those tiiat are currently used for providing access to tiie Internet and 
otiier wide area networks. For example, modem pool 14 may be provided by a local 
ISP. Thus, modem pool 14 may be coupled to a number of server computers, such as 
remote servers 16, via a conventional network infrastructure, which may be Internet 
mfrastructure 18. 

Figure 1 further Ulustrates an example of combining information retrieval over 
the Internet vnth television viewing. At least some of cUent systems 10 are associated 
with display devices 20 that serve a dual function. First, display devices 20 display 
grapbcal, computer-generated or computer-transmitted information provided by 
diem systems 10. Web pages retiieved from remote senders 16 represent one 
example of the graphical information that may be displayed on display devices 20. 
Second, television programming transmitted from television programming source 22 
may also be displayed on display devices 20. Television programming source 22 may 
be any desired television broadcaster or deliveor system. Accordingly, display device 
20 may be a conventional television or may instead be a computer monitor adapted to 
display television programming. Indeed. ti,e client system is optionally integrated in a 
television, or instead may be a self-contained unit. The invention extends to systems 
incorporating the information retrieval systems disclosed herein in combination with a 
home entertainment system including a television or another display device 20. It is 
also noted that cliem terminal 24 is defined herein to include the client system and tiie 
display device. 
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Figure 2 depicts selected elemOTts of one embodiment of a client system that 
may be used to implements portions of the invention. Client system 10 uses hardware 
and computer-executable instructions for providing the user with a grq)hical user 
interface, by whidi the user can access Internet resources, send and receive e-mail, 
and optionally receive other information services. Operation of dient system 10 is 
controlled by a central processing unit (CPU) 26, whidi is coupled to an application- 
specific integrated circuit (ASIC) 28. CPU 26 executes computer-executable 
instructions designed to implement features of client system 10, mcluding some of the 
steps of methods of the present invention. ASIC 28 contains drcuitry which is used 
to implement certain functions of client system 10. For example, ASIC 28 may be 
coupled to an audio digital-to-analog converter 30 and to a video mcoder 32, which 
provide audio and video output, respectively, to display device 20 of Figure 1. 

Client system 10 may fiirther indude an IR inter&ce 34 for detecting infixed 
signals transmitted by a remote control input device, such as a hand-held device or a 
wireless keyboard. In response to the infirared signals, IR interface 34 provides 
corresponding electrical signals to ASIC 28. Alternatively, the signals transmitted by 
remote control device 14 may be selected firom another suitable region of the 
spectrum. A standard telephone modem 36 and an ISDN modem 38 are coupled to 
ASIC 28 to provide connections to modem pool 12 and, via the Iirtemet 18, to remote 
serva-s 16. While the client system illustrated in Figure 2 includes both a telephone 
modem and an ISDN modem, either one of these devices is sufficient to support the 
communications of the client system. Furthermore, in other embodiments, modems 
36 and 38 may be supplemented or replaced with cable modem 40 or another suitable 
communications device. In other environments, communication may instead be 
established using a token ring or Ethernet connection. 

Also coupled to ASIC 28 are a mask read-only memory (ROM) 42, a flash 
memory 44, and a random access memory (RAM) 46. Mask ROM 42 is non- 
programmable and provides storage of computer-executable instructions and data 
structures. Flash memory 44 may be a conventional flash memory device that can be 
programmed and erased electronically. Flash memory 44 may store Internet browser 
software as well as data structures. In one embodiment, a mass storage device 48 
coupled to ASIC 28 is included in client system 10. Mass storage device 48 may be 
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used to supply computer-executable instmctions and data structures to other 
components of the cUent system or to receive data downloaded over the network. 
Mass storage device 48 may include any suitable medium for storing computer- 
executable instructions, such as magnetic disks, optical disks, and the like. 

Application software and associated operating system software are stored in 
flash memory 44, or instead may be stored in any other suitable memory device, such 
as mask ROM 42 or mass storage device 48. The computer-executable instructions 
that, according to one embodiment of the invention, are used to monitor television 
viewing habits of a user and to construct a user profile that forms at least part of the 
basis for selecting advertisements are executed by CPU 26. In particular, CPU 26 
executes sequences of instructions contained in one or more of mask ROM 42, flash 
memory 44, and RAM 46 to perform certain steps of the present invention that will be 
more specifically disclosed herdnafter. 

In one onbodiment of the invention, client system 10 is a WebTV client box 
manufactured by WebTV Networks, Inc. of Palo Alto, California. One reason that 
WebTV client boxes may be conveniently used with the invention is that they include 
tdevision interfece features that combine Internet browsing with television viewing. 
For example, the display device that is typicaUy used to graphically display Web 
resources retrieved by a WebTV system is a conventional television. Furthermore, 
WebTV client boxes may be adapted to monitor television viewing habits as fiirther 
disclosed herein. Alternatively, client system 10 may be any of a variety of systems 
for providing access to the Internet or other information retrieval systems. When a 
WebTV client box is used as cUent system 10, the network architecture illustrated in 
Figure 1 may fiirther include a dedicated server 50, which is dedicated to providing 
25 information specifically to WebTV clients boxes. 

The elements of client ^stem 10 are not limited to those depicted in Figure 2. 
For example, the invention may be used with other computer system configurations, 
including personal computers, hand held devices, multiprocessor systems, 
microprocessor-based or programmable consumer electronics, network PCs, 
minicomputers, mainfi-ame computers, and the like. The invention may also be 
practiced in distributed computing environments other than the network environment 
of Figure 1. For example, the invention may be used in any suitable network 
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environment where tasks are performed by remote processing devices that are linked 
through a communications network. 

Figures 3A-3C illustrate three embodiments of the invention, wherein 
advertisements are selected and inserted into an information document based at least 
in part on television viewing habits of the redpient. In general, the embodiments of 
Figures 3A-3C are configured to monitor the television viewing habit of a user of the 
client system and to construct a user profile that includes the television viewing 
habits. Based at least in part on the television viewing habits, an appropriate 
advertisement is selected according to advertisement selection criteria. The selected 
advertisement is inserted into an Internet document and is displayed to the user on the 
display device. Advertisement selection and insertion is conducted at the remote 
server in Figure 3 A and at the Internet service provider and the client system in Figure 
3B and 3C, respectively. 

Turning now to Figure 3A, television programming source 22 broadcasts a 
tde\ision programming feed that is displayed to the user on display device 20. A 
television monitoring module 52 at client system 10 has access to the television 
programming feed and detects the identity or the content of the television 
programming used by the user. A more detailed description of one embodiment of a 
television monitoring module is disclosed herein in reference to Figure 6. 

A user profile 54 compiled at client system 10 is a profile of the user of the 
client system 10 and includes at least information relating to the television 
programming displayed on display device 20. User profile 54 may also include other 
user information fiirther characterizing the user. Examples of such user information 
include demographic information, Internet usage data, geogrsqjhical information, or 
other identifying information. U.S. Patent Application Serial No. 09/094,851, filed on 
June 15, 1998, discloses user profiles and specific example of user information, many 
of which may be included in the user profiles of the present invention. For purposes 
of disclosure, the foregoing patent application is hereby incorporated by reference. 

The information included in user profile 54 may be compiled over any desired 
period of time. For example, user profile 54 may be updated each time the user views 
a television program. Information relating to viewed television programming may be 
retained in user profile 54 for a set period of time. According to one option, the most 
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recently viewed television progranuning is given more weight in user profile 54 than 
older programming. Alternatively, user profile may include infoimation relating to 
only the most recently viewed television programming. 

CUent system 10 provides Internet access to the user by means of an Internet 
browser 56, which may be any conventional or other Internet browser that is adapted 
or otherwise capable of transmitting information included in user profile 54 as fiirther 
described herein. For example, when client system 10 is a WebTV cUent box, 
Internet browser 56 is the Internet browser typically included in WebTV client boxes, 
with the browser being adapted to transmit user profile information. The Internet 
browser 54 included in cUent system 10 is one example of means for requesting an 
information document from a server computer. 

A user enters commands to client system using input device 58, thereby 
requesting an information document from remote server 16. When client system 10 is 
a WebTV client box, input device 58 may be a handheld remote control device or a 
wireless keyboard that aUows the user to select and retrieve desired Internet resources. 
Alternatively, the input device may be a keyboard, a mouse, or another device that is 
conventionally used to provide user input to an Internet browser. It is noted that a 
user may access the Internet by means of the Internet browser 56 at any time after 
having viewed television programming on display device 20. For example, the user 
may interrupt television viewing to access the Internet or, alternatively, may access 
the Internet some time after having stopped watching television programming. 

The Internet browser sends a uniform resource locator (URL) via Internet 
service provider 60 to a document retrieval module 62 at remote server 16. For 
example, the network architechire by which client system 10 communicates with 
remote server 16 may be that disclosed in Figure 1. Methods and systems for 
retrieving an information document over the Internet or otiier information retrieval 
systems are well known in the art. In the embodiment of Figure 3A, wherein 
advertisement selection and insertion into the information document is conducted at 
remote server 16, client system 10 fiirther sends information from user profile 54 to 
an advertisement selection decision unit 64 at remote server 16. As previously noted, 
the information user profile 54 identifies the television viewing habits of the user of 
client system 10. 
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In this embodiment, remote server 16 includes features for providing a 
plurality of advertisements and for selecting and inserting an advertisement into the 
requested information document. In one implementation, an advertisement source 66 
suppUes a plurality of advertisements tiiat are stored in advertisement repository 68. 
In one embodiment, advertisement source 66 and remote server 16 may be operated 
by the same party. Alternatively, advertisement source 66 may be operated 
independentiy from remote server 16 and located at a remote site. The pluraUty of 
advertisements provided by advertisemem source 66 may be associated with a wide 
variety of advertisers and goods and services. 

In this embodiment, remote server 16 further includes advertisement selection 
criteria 70, which, in conjunction witii the user profile information, govern the 
selection of an advertisement stored in advertisemem repository 68. For example, the 
selection criteria may provide tiiat an advertisement whose subject matter corresponds 
to tiie television viewing habits of the user is to be selected, OptionaUy. 
advertisement selection criteria 70 forther incorporates any of ti.e conventional 
techniques for selecting advertisements, including selecting an advertisement to 
correspond to tiie subject matter of tiie requested information document. 

Remote server 16 retrieves requested information document 72 from a 
document cache 74 according to metiiods tiiat will be understood by tiiose skilled in 
tiie art. The information document 72 may be provided by a contem provider who is 
also the operator of remote server 16. Alternatively, tiie content provider who 
provides information document 72 may be an entity tiiat purchases information 
document posting services from tiie operator of remote server 16. Information 
document 72 may be any Internet resource or another computer-displayable or 
computer-transmitted data structure. For example. Hyper-Text Markup Language 
documents ("HTML documents") are commonly retrieved over tiie Internet and are 
particulariy suited for use with the invention. 

An advertisemem insertion module 76 inserts data representing selected 
advertisement 78 into information document 72 after it is retrieved. For example, the 
selected advertisement may be embedded in tiie information document 72 according 
to conventional techniques. After tiie selected advertisement is inserted, the requested 
information document 72 is transmitted from remote server 16 to client system 10. 
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Internet browser 56 displays the information document 72 and the selected 
advertisement 78 on display device 20, which is one example of means for displaying 
the information document. In this manner, the user of the client system views an 
advertisement that is determined to be appropriate based at least in part on the 
television viewing habits of the user. Selecting and inserting the advertisement at the 
remote server is advantageously compatible with current techniques of advertisement 
ins«tion, which are also conducted at the remote server. 

Figure 3B illustrates an embodiment of the invention wherein advertisement 
selection and insertion are conducted at the level of the Internet service provider. 
Television programming is viewed by the user and a user profile 154 is compUed at 
cUent system 110 in much the same way as described herein in reference to Figure 
3A. Whoj a user requests an information document fi-om a remote server according 
to this embodiment, the URL is transmitted to the remote server via a request router 
80 at the Internet service provider 160. The user profile, however, is transmitted to 
and stored at Internet service provider 160. Information fi-om user profile 154 may be 
transmitted each time the user requests resources &om the Internet, at the beginning of 
each Int«net session that is served by Internet s«vice provider 160, or periodically at 
any desired interval. For example, client system 110 may update user profile copy 
154' on a daily basis, regardless of whether the user has accessed the Internet during 
the day. Furthermore, Internet service provider 160 may maintain user profile 
information associated with a plurality of client systems. The method of selecting 
advertisements at Internet service provider 160 may be substantially similar to the 
methods for selecting advertisements at remote server 16 described in reference to 
Figure 3A. Alternatively, advertisement selection decision unit 164 may select 
appropriate advertisements for cUent system 110 and compUe a list of appropriate 
advertisements before any information document is requested by client system 1 10. 
In this case, the preselected advertisements are aheady identified and available for 
insertion into requested information documents when the user begins to access to the 
Internet. 

Advertisement insertion module 176 of Figure 3B may insert the selected 
advertisement into the requested information document according to one of at least 
two methods. First, the information document transmitted fi-om remote server 116 to 
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IntOTiet service provider 160 may include a vacant field or anther location to which 
the selected advertisement may be added. Second, advertisement insertion module 
176 may overwrite an advertisement akeady included in the requested information 
document, thereby replacing the existing advertisement with the selected 
advertisement. 

The requested information document, including the selected advertisement, is 
next transmitted firom Internet service provider 160 to the Internet browser 156 at 
client system 1 10. The information document and the selected advertiswnent may be 
displayed at display device 120 according to the methods disclosed in reference to 
Figure 3A. Accordmg to the embodiment of Figure 3B, the user receives 
advertisements selected based at least in part on the television viewing habits of the 
user. Selecting and inserting the advertisements at the level of the Internet service 
provider have the advantage of allowing a periodically updated copy of the user 
profile to be stored at the Internet service provider. Accordingly, the Internet service 
provider may preselect advertisements for the users of a plurality of client systems. 

Figure 3C illustrates a fixrther embodiment of the invration, wherein 
advertisem^ts are selected and inserted at the client system. The methods and 
systems for viewing television programming, monitoring the television programming, 
and compiling a user profile may be substantially similar to those disclosed in 
reference to Figures 3 A and 3B. In this embodiment, however, the advertisement 
selection decision unit 264, the advertisement repository 268, and the advertisement 
selection criteria 270 are located at the client system 210. The user requests an 
information document fi-om remote server 216 via Internet service provider 260 
according to methods that may be similar to those disclosed in reference to Figures 
3A and 3B, with the exception that user profile information does not need to be 
transmitted fi-om client system 210. In particular, a selected advertisement 278, which 
may be identified before the user requests any Internet resources fi:-om the remote 
server, may be inserted into retrieved information document by Internet browser 256. 

As described in reference to Figure 3B, selected advertisement 278 can be 
inserted into the information document at a vacant field, or instead may replace an 
advertisement already included in information document. The information document 
with the selected advertisement embedded therein is then displayed to the user on 
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display device 220 according to the methods disclosed herein. According to this 
embodiment, the advertisements are selected and inserted without transmitting any 
information relating to television viewing habits from client system 210. Because the 
Internet service provider and the remote seiver do not have access to the television 
viewing habits of the user, the privacy of the user with respect to television habits is 
maintained. 

Figure 4 is a flow chart depicting selected steps of the methods associated with 
Figures 3A-3C. ^ step 410, the user views television programming, and the subject 
matter of the television programming is monitored at the dient system. In step 412. 
the user profile, including information relating to the television viewing habits of thi 
user, is compiled at the cUent system. The user requests an information document, 
such as a Web page, using an Internet browser at the client system as illustrated by 
step 414. In step 416. an advertisement determined to be appropriate based at least in 
part on the user profile is selected for insertion into the requested information 
document. The selected advertisement is then inserted in step 418 mto the 
information document. Steps 416 and 418 may be conducted at the remote server, the 
Internet service provider, or the dient system as disclosed in reference to Figures 3A- 
3C. Finally, the requested information document, including a selected advertisement. 
IS displayed to the user according to step 420. 

Figure 5 iUustrates a fiirther embodiment of the invention, wherein any type of 
information may be selected and displayed to a user based at least in part on the 
television viewing habits of the user. For example, the information displayed' to the 
user may be news, educational resources, advertising, entertaimnent, or any other 
desired type of information. In one hnplementation. the information retrieval system 
automatically provides and displays reference information relating to the content of 
the television programming viewed by the user. For example, the reference 
mformation may include reviews, information about the cast, and other items of 
interest to television viewers. 

According to the embodiment of Figure 5, a television programming source 
322 provides a television programming feed to display screen 320 according to 
methods described in reference to Figures 3A-3C. Furthermore, television monitoring 
module 352 detects the identity or content of the television programming viewed by 
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the user and stores information relating thereto in programming information 
repository 382. For example, the programming information may identify one or more 
topics associated with the television programming. In this embodiment, dient system 
310 fiirther includes a list of information categories 388, each being associated with 
information documents stored in a document cache 374 at remote server 316. A 
category selection module 384 compares the programming information with the 
information categories to select at least one information category 386 that corresponds 
to the television programming viewed by the user. The comparison of the 
programming information with the information categories 388 may be fecilitated by 
selection criteria similar to the advertisement selection criteria disclosed in reference 
to Figures 3A-3C. By way of example, and not by limitation, the selection criteria 
may provide tiiat a selected information category 386 is identified by looking for a 
direct match between a keyword in die programming information and a keyword in 
information categories 388. 

When selected category 386 is identified, Internet browser 356 transmits a 
request to remote server 316 via Internet service provider 360 for one or more 
information documents assodated witii the selected category. Documait retrieval 
module 326 then retrieves one or more information documents from document cache 
374. These information documents are then downloaded to Internet browser 356 and 
displayed on display device 320. According to one option, tiie information document 
may be displayed on display device 320 simultaneously with the television 
programming. For example, the information document may be overiaid on a selected 
region of tiie display device 320 or the display device may be divided into a 
split-screen arrangement. According to anotiier option, tiie information documents 
are displayed on display device 320 only when the television programming feed to 
display device 320 is terminated or when the user aflBrmatively indicates that it is 
appropriate to display the information documents. 

Information categories 388 may be fiirther taUored or narrowed to correspond 
to tiie viewing habits of tiie particular user, periodically updated from a remote source 
such as remote server 316, or selected by the user. For example, if it is noted tiiat a 
user repeatedly views television programming related to sports, the information 
categories can be supplemented with subcategories relating to more narrow sports 
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topics. One method offurthertaUormginfomiation categories 388 to correspond 
frequently viewed topics involves using a user profile simUar to those described in 
reference to Figures 3A-3C. For example, a user profile indicating that the user 
frequently views particular sporting events may be used to retrieve subcategories from 
a remote server, which then can supplement the standard infoimation categories 388. 
Direct user input may also be used to select or fiirther refine information categories 
388. This may be accomplished by providing a large Ust of information categories 
from which the user may pick and choose to identify the categories that are likely to 
be of most interest. 

According to this embodiment of the invention, retrieval of news, 
entertaimnent, educational resources, or other information documents based at least m 
part on the television viewing habits of the user can be conducted automatically, with 
no user assistance. Such techniques provide automatic access to information that is 
likely to be of use and of interest to the recipient. 

Figure 6 illustrates one example of a television monitoring module that may be 
used with the various embodiments of the invention. In this example, television 
programming source 22 broadcasts closed^aptioning information 90 in addition to 
standard programming 92. Closed^ptionmg information 90 is routed to a closed- 
captioned monitoring unit 94. which detects keywords or otherwise determines the 
subject matter of the television programming 92 based on the closed-captioning 
information 90. 

AdditionaUy. television monitoring module 52 accesses an electronic 
programming database ("EPD") 96 that includes written or encoded descriptions of 
the subject matter of television programming 92. Based on the information from 
electronic database 96, EPD monitoring unit 98 determines the subject matter of 
programming 92. Closed-captioning monitoring unit 94 and EPD monitoring unit 98 
update user profile 54 with the identified subject matter of the programming 92. For 
example, television monitoring module 52 may have access to a plurality of 
programming categories similar to information categories 388 of Figure 5. In this 
case. EPD monitoring unit 98 and closed-captioned monitoring unit 94 identify one or 
more programmmg categories 100 that best correspond to the subject matter of 
programming 92 and cause these programming categories to be included in user 
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profile 54. For Uhistiation purposes, Figure 6 shows television monitoring module 52 
as including a closed captioning monitoring unit 94 and an EPD monitoring unh 98, 
both of which are examples of means for monitoring the television programming 
viewed by the user. However, in many instances, only one of the foregoing 
monitoring units is sufficient to identify the content of the television programming. 
Furthermore, the invention is not limited to monitoring the content of television 
programming using closed captioning information or an electronic programming 
database, but may utilize other means for monitoring the television programmmg. It 
is also noted that either of the closed captioning monitoring unit 94 or the EPD 
monitoring unit 98 in combination with programming categories 100 represent but 
one example of means for compiling a user profile. 

The present invention may be embodied in other specific forms without 
departing fi-om its spirit or other essential characteristics. The described embodiments 
are to be considered in all respects only as illustrative and not restrictive. The scope 
of the invention is, Uierefore. indicated by die appended claims rather than by the 
foregoing description. All changes which come within the range of equivalency of 
the claims are to be embraced within their scope. 
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1. In an information retrieval system including a server computer and a 
client system having a display device, wherein the cUent system has access to 
television programming viewed by a user of the information retrieval system, a 
method for inserting an advertisement into a document displayed on the display 
device the method comprising the steps of: 

compiUng a profile of the user of the information retrieval system, 

including at least information associated with the television programming 

viewed by the user; 

requesting, by the cUent system, an information document from the 
server computer, 

selecting, based at least in part on the profile and on designated 
selection criteria, an advertisement from among a plurality of advertisements 
for insertion into the information document; 

inserting data representing the selected advertisement into tiie 
information document; and 

displaying the information document, including the selected 
advatisement, on tiie display device. 

2. A metiiod as defined in claim 1, wherein the step of inserting data 
representing the selected advertisement is conducted at tiie server computer. 

3. A method as defined in claim 1, wherein the step of inserting data 
representing tiie selected advertisement is conducted by an Internet service provider. 

4. A method as defined in claim 1. wherein the step of inserting data 
representing tiie selected advertisement is conducted at the cUent system. 

5. A metiiod as defined in claim 4, fiirtiier comprising, before the step of 
selectmg an advertisement, tiie step of receiving tiie plurality of advertisements at the 
client system. 

6. A method as defined in claim 5, fiirtiier comprising the step of storing 
the plurality of advertisements at the client system after the step of receiving the 
plurality of advertisements. 

7. A method as defined in claim 1, wherein tiie information document is 
an HTML document. 
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8. A method as defined in claim 1, v^erein the step of compiling the 
profile indudes the step of including in the profile user information fiirther 
charactering the user, in addition to the tdevision programming viewed by the user. 

9. In an information retrieval system including a server computer and a 
client system having a display device, wherein the client system has access to 
television programming viewed by a user of the information retrieval system, a 
method for inserting an advertis^ent into a document displayed on the display 
device, the method comprising the steps of: 

compiling a profile of the user of the information retrieval system at 
the client system, the profile including at least mformation associated with the 
television programming viewed by the user; 

transmitting the profile fi-om the client system to the server computer, 
requesting, by the dient terminal, an information document fi^om the 
server computer; 

selecting, by the server computer, an advertisemmt fi-om among a 
plurality of advertisements for ins^on into the information document, the 
advertisement being selected based at least in part on the profile and on 
designated selection criteria; 

inserting, by the server computer, data representing the selected 
advertisement into the information document; 

transmitting the information document, including the data, to the client 
system; and 

displaying the information document, including the selected 
advertisement, on the display device. 

10. A method as defined in claim 9, wherein the step of compiling the 
profile comprises the step of identifying content of the television progranmiing using 
an electronic television programming database having a content description 
corresponding to the television programming. 

11. A method as defined in claim 9, wherein the step of compiling the 
profile comprises the step of identifying content of the television programming by 
monitoring closed captioning information assodated with the television 
programming. 
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12. A method as defined in claim 9, v^erein the step of compiling the 
profile comprises the step of including demographic information assodated with the 
user in the profile. 

13. In an information retrieval system including a server computer and a 
5 client system having a display device, wherein the cUent system has access to 

television programming viewed by a user of the information retrieval system, a 
method for displaying information on the display device in response to the television 
programming, the method comprising the steps of: 

monitoring, by the client system, television programming viewed by 
the user of the information retrieval system; 

comparing the television programming viewed by the user to a 
plurality of information categories to identify at least one information category 
that corresponds, according to designated selection criteria, with the television 
programming; 

requesting, by the client system, an information docum^t classified 
under the at least one identified information category fi-om the server 
computer; and 

displaying the information document on the display device. 

14. A method as defined in claim 13, wherein the information document 
20 includes news. 

15. A method as defined in claim 13, wherein the information document 
includes reference information relating to the content of the television programming. 

16. A method as defined in claim 13, fiirther comprising, prior to the step 
of comparing the television programming viewed by the user to the plurality of 

25 information categories, the step of selecting the plurality of information categories 
based in part on user input. 

17. A method as defined in claim 13, fiirther comprismg, prior to the step 
of comparing the television programming viewed by the user to the plurality of 
information categories, the step of selecting the plurality of information categories 

30 based at least in part on a profile of the user. 

18. A method as defined in claim 17, wherein the profile includes 
information associated with the television programming viewed by the user. 
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19. A method as defined in claim 13, wherein the step of requesting an 
information document is conducted without direct user assistance. 

20. A computer program product for implementing a method of displaying 
an information document including an advertisement selected at least in part on 
television programming viewed by a user of an information retrieval system, wherein 
the method is implemented in a client system of the mformation retrieval system, the 
computer program product comprising: 

a computer-readable medium carrying computer-executable 
instructions for implementing the method, wherein the computer-executable 
instructions comprise: 

program code means for monitoring television programming 
viewed by the user; 

program code means for compiling a user profile, wherem the 
user profile includes information assodated with the television 
programming viewed by the user, 

program code means for requestmg an information docmnent 
from a server computer, and 

program code means for displaying the information document 
having the advertisement included therein, wherein the advertisement 
has been selected fi-om a plurality of advertisements based at least in 
part on the user profile. 

21. A computer program product as defined in clmm 20, wherein the 
computer-executable instructions fiirther comprise program code means for initiating 
transmission of the user profile to the server computer, wherein the advertisement is 
selected fi-om the plurality of advertisements at the server computer. 

22. A computer program product as defined in claim 20, wherein the 
computer-executable instructions fiirther comprise program code means for initiating 
transmission of the user profile to an Internet service provider, wherein the 
advertisement is selected fi-om the plurality of advertisements at the Internet service 
provider. 
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23. A computer program product as defined in claim 20, wherein the 
computer-executable instructions further comprise program code means for selecting 
the advertisement fi-om among the plurality of advertisements at the client terminal. 

24. A computer program product as defined in daim 23, wherein the 
computer-executable instructions further comprise program code means for receiving 
the plurality of advertisements fi-om an advertisement source and storing the pluraUty 
of advertisements at the client system. 

25. A computer program product as defined in claim 23, wherein the 
computer-executable instructions fijrther comprise program code means for inserting 
data representing the selected advertisement into the information document. 

26. A computer program product as defined in claim 20, wherein the 
program code means for monitoring television programming comprises program code 
means for monitoring an electronic programming database that includes content 
descriptions associated with the television programming. 

27. A computer program product as defined in claim 20, wherein the 
program code means for monitoring television programming comprises program code 
means for monitoring closed captioning information associated with the television 
programming. 

28. A system configured to display an information document including an 
advertisement selected at least in part on television programming viewed by a user of 
the system, the system comprising: 

a home entertainment system for providing the television programming 
viewed by the user, including: 

a television programming feed for delivering the television 
programming; and 

a television for displaying the television programming; and 
an information retrieval system including: 

means for monitoring the television programming viewed by 
the user; 

means for compiling a user profile, including at least 
information associated with television programming viewed by the 



user; 
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means for requesting an infonnation document from a server 
computer, and 

means for displaying the information document having the 
advertisement included therein, \^erein the advertisement has been 
selected from a plurality of advertisements based at least in part on the 
user profile. 

29. A system as defined in claim 28, wha-ein the means for displaying the 
information document comprises the television of the home entwtainment system. 

30. A system as defined in claim 28, wherein the means for requesting an 
information document comprises an Internet browser. 

31. A system as defined in claim 28, wherein the means for monitoring the 
television programming viewed by the user comprises an electronic programming 
database monitoring unit. 

32. A system as defined in claim 28, vAicrem the means for monitoring the 
television programmmg viewed by the user comprises a closed captioning monitoring 
unit. 
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